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ABSTRACT 


This thesis investigates the need to predict life cycle cost in the most 
effective and efficient manner through the development of cost estimating 
relationships (CERs) using only performance input parameters. Utilizing 
statistical software especially developed for program managers, parametric 
cost estimating relationship module (PACER), CERs were developed and then 
evaluated for statistical soundness. The object of this study was to develop 
a means by which the program manager could estimate fairly accurately total 
life cycle costs. With this information in hand, the program manager could 
determine if a weapon system is affordable early in the acquisition process. 

The result of this study was the derivation of three predictive models 
that relate cost to required performance parameters. Based solely upon 
performance requirements, a relationship between cost and required 


performance was established and their impact upon life cycle costs. 
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ir UN PRODUC EON 


A. OVERVIEW 

The fall of the Berlin Wall signalled an end to the cold 
war, and an uncontrollable federal budget deficit seeking new 
heights, the Department of Defense's budgetary practices have 
come under extraordinary political oversight. The era of 
"Defense Reduction" has begun, and by the year 1995, one third 
of the present day operating forces have been forecasted to be 
dissolved (Aaron and others, 1990). A reduction in both 
budget authority and outlays will occur across all defense 
categories. The emphasize will be to spend money wisely the 
first time, especially when estimating costs for procurement 
of new weapon systems. Major acquisitions are coming under 
intense congressional oversight to insure that they are 
affordable. 

Who is responsible within the Department of Defense (DOD) 
for weapon system acquisition? The primary advocate for any 
weapon system program is the program manager (PM). The PM 
must understand the military need for his particular system 
and become intimately involved with its evolution. This 
evolution involves a series of minor decisions that may have 
a major impact upon the program. Therefore, the PM must 


understand and appreciate the implication of each and every 


trade-off decision that is made. He alone is responsible and 
accountable for the success or failure of the program 
(Fitzgerald, 1990). 

The dire need to maintain new technological advance weapon 
systems will only increase but, the costs of these advances 
will be severely scrutinized. This is the problem facing the 
Marine Corps' amphibious assault vehicle program. New 
requirements to be able to launch an amphibious assault from 
over-the-horizon (OTH) has come of age (Marine Corps Gazette, 
July 1991). Presently, the Marine Corps conducts amphibious 
assaults with the amphibious assault vehicle, AAV7A1. This 
amphibious assault vehicle is the last of a long line of 
procurement stemming from the development of the LVPT-7 
Amphibian Tractor Program during the early 1970s. The AAV7A1 
does not have the nautical range nor land speed required to 
conduct future offensive operations into the next century. 

The current AAV7A1 will reach the end of its service life 
Shortly after the turn of the century in year 2000 (Kusek, 
1991). Several possible replacements have been designated as 
the Advanced Amphibious Assault Vehicle (AAAV) and are 
currently passing milestone one of the acquisition process. 
The need to develop an effective tool to predict accurate life 
cycle costs is essential to the successful development of the 
AAAV. The past track record of the LVPT-7 Amphibian Tractor 
Program proved that combat effective hardware could be 


delivered on schedule and, within funded ceilings (Bahnmaier, 


mvojwe the need to continue this trada tation formthe AAAV can 
be obtained through the use of parametric cost analysis 
techniques which can further used to develop Cost Estimating 
Relationships (CERs) to predict accurate life cycle costs. 
What is life cycle cost? As defined, life cycle costs 
(LCC) is the total cost to the government to acquire and own 
a system. This includes cost of development, procurement, 
operation and support (Fitzgerald, 1990). In this study life 
cycle costs will be broken down into three distinct elements: 
Research, Development, Testing, and Evaluation (RDT&E) Costs; 
Procurement (Proc.) Costs; Operation and Support (0O&S) Costs. 


The LCC formula that is applied throughout this study is: 


LCC = RDT&E + Proc. + O&S 


The stage is set with the development of new technology 
during a time of considerable budget restraint. On the one 
hand, there exists the natural development of OTH amphibious 
landings, and on the other the development of technology that 
presently does not exist. The difference between successfully 
fielding or fraudulently floundering will be the ability to 
predict the costs of new technological advances. The mission 
has always been paramount but, in these days of budget 
constraints, costs will the most significant determining 


fecctor. 


B. OBJECTIVES OF RESEARCH 

The objectives of this study are to : (1) develop a Cogm 
Estimation Relationship that will be able to reasonably 
predict the life cycle costs of the planned Advance Amphibious 
Assault Vehicle, (2) define the costs associated with 
technological advancements in meeting mission requirement of 
over-the-horizon (OTH) and sustained mobile combat operations 


ashore. 


C. RESEARCH QUESTIONS 

To support this study's research the following primary 
question was proposed: What will be the anticipated life cycle 
costs of the follow on to the Amphibious Assault Vehicle, 
AAV7R1? 

In support to this question, the following subsidiary 
questions were addressed: 


1. What will be the trade off effect on increasing range 
and speed upon the life cycle costs of the AAAV? 


2. Does the developed Cost Estimation Relationship (CER) 
meet acceptable statistical test model parameters in 
regard to; Coefficients of Determination (R’), Coefficient 


of Variation (CV), Standard Error (SE), t-ratio tes sane 
thesP-stawistre. 


D. RESEARCH METHODOLOGY 
Basic information presented in this study was obtained 
from: (1) current literature, (2) Defense Logistics Studies 


Information Exchange GO py i op (3) Defense Technical 


Information Center (DTIC), and (4) the Department of Defense 


directives and instructions. The cost data was collected 
from many government agencies to include the program office 
responsible for development of the AAAV. Additional cost data 
was obtained from various references located in Knox Library 
@ue Naval Postgraduate School Monterey, California. The 
development of CERs was done with statistical software package 
known as Parametric Cost Estimating Relationship Module 
(PACER) provided from the Defense Systems Management College 
at Fort Belvoir, Virginia. 

The selection to use PACER was two folded. In the first 
place, the author of this study wanted to test the simplicity 
of the program since, it was originally conceived to be used 
by novice program managers with little or no statistical 
background. Secondly, this thesis can be used as a data base 
source document with specific PACER application which can aid 


in further evaluation of the software as it is developed. 


ioe COUPE OF STUDY 

The main thrust of this study will be the development of 
a cost estimation relationship that can be used to accurately 
predict the life cycle costs of the AAAV. The intent of this 
estimation is to aid DOD decision makers such as program 
managers with a summary of information depicting the cost 
tradeoff between the requirement of additional speed and range 
essential to the OTH amphibious operations in the development 


of the AAAV. Armed with this information, the decision maker 


can better assess the present condition of the AAAV program in 
respect to present cost and future costs throughout the 


milestone process. 


F. LIMITATIONS 

The major element in using parametric analysis is data. 
Consequently, the validity of the data in conjunction with 
expanding technologies will determine the accuracy of the CER. 
For example, if the development of a CER was solely based upon 
historical costs alone, it can be misleading especially when 
considering the development of new technologies. The data 
used in this study tried to match similar technologies with 
projected requirements in order to achieve an accurate 


prediction of life cycle costs. 


G. ASSUMPTIONS 

It is assumed that the reader of this study has a basic 
understanding of the concepts dealing with parametric 
statistical analysis to include aforementioned statistical 


tests approaches. 


H. ORGANIZATION OF STUDY 

Chapter II describes the three approaches associated with 
parametric cost analysis. Chapter III develops CERs for 
further application to set parameters for the AAAV with 
application to four phases of parametric analysis; Data 


Collection, Data Analysis/Adjustment, Data Manipulation, and 


CER Derivation. Chapter IV provides recommendations and 
concluding application upon the derived CER with remarks for 


future research. 


II. OVERVIEW OF COST ESTIMATING 


A. INTRODUCTION 

What is cost estimation? One definition is that a coum 
estimate is a judgement or opinion regarding the cost of an 
object, commodity, or service (Batchelder and others, 1969). 
This judgement is arrived at through some sort of methodology 
based upon the assumption that experience is a reliable guide 
£O Ene furure, The ability to attach a cost to certain 
actions or factors leading to an estimate of future services 
is how most estimating 1s done presently. 

The greatest challenge to cost analysts when estimating 
costs for military equipment is to develop relationships for 
new technologies usually significantly different from that of 
any predecessor. To predict cost of the next generation 
aircraft, missiles, and amphibious track vehicles with no 
historical basis coupled with a myriad of industrial 
innovations, greatly complicates the analysts' job by 
increasing the unknown or uncertainty of the estimate. 
Obviously, the analyst must weigh each of these uncertainties 
against any derived cost estimate. Usually if the estimate is 
based upon a credible statistical approach, the uncertainty 


can be further investigated and hopefully explained. 


The approaches used in cost estimating span the entire 
range from intuition, at one extreme, to a detail work 
breakdown structure at the other. There exists five basic 
approaches to cost estimating: industrial engineering, catalog 
pricing, estimating relationships, specific analogies, and 
expert opinion (Batchelder and others, 1969). anemic iv i ng 
factor on which approach to use can be a multitude of things. 

For instance, if a PM has to make a quick decision about his 
program and is constrained by funds then he would probable opt 
for a parametric estimation vice an industrial engineering 
estimation because, it is cheaper and faster. Traditionally, 
most of the Defense Department cost estimations have been 
prepared using three of these five approaches and this will be 
the focus of this study. The other two, catalog pricing and 


expert opinion were considered too subjective for inclusion. 


B. INDUSTRIAL ENGINEERING COST ESTIMATES 

Estimating by industrial engineering (IE) can be defined 
as the bottom-up, or more casually known as the grass roots, 
m@eprodacn to costing. Both labor and material are 
painstakingly measured at the lowest level of production as 
described by a detail work breakdown structure (WBS). After 
the cost have been assigned to each individual task and level, 
the results are aggregated to estimate the total project cost. 

Industrial engineering estimates are time consuming, labor 


intensive, and very costly to prepare. Consequently they are 


not desirable to program managers who are constantly faced 
with every tightening funding constraints in today's world. 
An example of the immense detail evolved with this type of 
approach is best described by the following quote, "One of the 
largest aerospace firms judges that the use of this approach, 
IE, in estimating the cost of an airframe requires about 4500 
estimates to be completed before a reasonable total cost 
estimate is achieved.” (Batchelder and others, 1969). 
Industrial engineering estimates are especially vulnerable 
to design changes resulting from the customer and/or plant 
innovations that occur throughout the production process. IE 
estimates are based from the initial contract that does not 
account for any possible change in the development of a 
product. The production process itself can become extremely 
involved. Many times difficulty arises that are hard to 
quantify early ina process especially, when trying to assign 
specific cost to jobs (Large and others, 1988). Given the 
current world situation and inevitable fiscal cuts in the DOD 
budget, production requirements will slow down causing a shift 
upward of life cycle costs (Fox and Field, 1988). IE 
estimates do not anticipate such changes resulting in less 


accurate life cycle costs estimates. 


C. SPECIFIC ANALOGIES 
Throughout the IE estimating process, costs are normally 


based upon historical references. However, when new processes 
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are introduced to fabricate new hardware, analogies by expert 
Opinion are done to makeup for the lack of reference material. 
For example if system X requires 100 hours to be completed, 
given the likenesses and differences in both design and 
performance requirements, then system Z is estimated to be 
completed in 150 hours (Batchelder and others, 1969). 

The major problem with this approach is that the estimate 
is usually based upon a sample population of one with 'a 
subjective adjustment for task complexity or performance 
requirement. Considering basic statistical analysis, such a 
procedure can lead to misconstrued conclusions not only about 
the cost estimate but also, the production process itself. If 
the process is based solely on one person's judgement then 
obviously it is not reproducible. Therefore, it can not be 
evaluated by the recipient of the estimate. In other words, 
the judgement call made by the expert can not be questioned by 
a person outside the process. When does the analogy cost 
estimation work best? 

Consider when a new technology changes the production 
process to such an extent eliminating any possible inference 
to historical data of past developments, the use of a specific 
analogy (SA) becomes the best course of action in obtaining a 
cost estimate. The SA estimation is best used in the early 
development phases of a weapon system. This estimate can be 
used to determine the economic feasibility of the requested 


design requirements. This approach when used in the 


hat 


acquisition process must be considered a tool to test the 
affordability arena when trying to field a project. 

These first two approaches provided a means to cost 
estimate that refer to the program manager essential insight 
to certain aspects of his program like initial affordability 
considerations. Still amore accurate and verifiable approach 
is needed to predict life cycle costs. This leads to the 
final cost estimation approach considered essential in this 


study of estimating relationships. 


D. ESTIMATING RELATIONSHIPS 

The final approach considered by this study to develop 
cost estimates is known as "top-down costing." With the cost 
of providing estimates always increasing and the fiscal dollar 
available to pay for these estimates seemingly decreasing, the 
statistical approach of top-down costing has become prominent. 


The statistical method well known as, parametric cost 


relationships estimating ", is defined as an estimate which 
predicts costs by means of explanatory variables such as 
performance characteristics, physical characteristics, and 
characteristics relevant to the development process, as 
derived from experience on logically related systems (Baker, 
Poe From this process, cost estimating relationships 
(CERs) are formulated using mathematical equations that relate 


system developmental costs to various explanatory variables 


and historical cost data (Miller and Sovereign, 1973). 
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Usually during@the concept phase of ‘the acquvwisition 
process before detailed engineering plans are formulated, 
parametric cost estimates with accompanying CERs are used to 
provided: 


(1) Possible cost/performance tradeoffs in the design 
effort to meet stated requirement parameters. 


(2) A data base for which review of cost effectiveness can 
be done. 


(3) A method to rank competing alternatives. 
This approach can compensate for unanticipated design changes 
and unforeseen production problems. The data used in the 
development of CERs was obtained from comparable weapon 
systems which probable experienced Similar unknown 
Circumstances and can give a historical clue to the cost 
associated with such changes. 

Parametric cost estimates (PCE) do not replace industrial 
engineering estimates but, provide a means to check the 
validity of the cost data. Any large unexplainable 
differences between IE and PCE should signal the program 
manager that further investigation is warranted. tin che 
application of all three approaches is done correctly, the 
accuracy of the final cost estimate will only improve. 

1. Cost Estimating Relationships 

The two major categories of CERs are input variables 
and output variables. First, the input CERs are a functions 


of the system's input parameters typically used for physical 


iS 


description like weight, volume, and density. The output 
CERs are functions of the system's output parameters such as 
speed, range, and payload. If both input and output 
parameters are used simultaneously, in the derivation of a 
CER, then a possible problem with muticollinearity between 
Variables could occur. This can lead to statistically 
unsound estimates and eventually to misconstruing cost 
estimates (Miller and Sovereign, 1973). 

The generally acceptable explanatory parameters used 
to estimate procurement costs of a weapon system is weight. 
"Cost has found to correlate very well with weight.", quoted 
from Beltramo and Morris who, devised a method to calculate to 
calculate Weight Estimating Relationships (WER) from design 
and performance characteristics of eighteen sub-systems in 
aircraft (Beltramo and Morris, 1980). With this informataed 
a CER was derived using weight as the key parameter in 
estimating costs. The major disadvantage with this procedure 
is that it involves two consecutive statistical analysis, 
each possibly contributing to some cumulative error. The use 
of one estimate to derive another estimate is statistically 
undesirable largely due to the possibility of error 
propagation from the first to the second (Gaioni and Polley, 
Isisholy This is the major drawback of using established 
engineering cost data in developing a CER. To preclude this 
study from this problem, the focus will be on performance 


based data in the development of a life cycle cost CER. This 
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will allow the tradeoff between new required performance 


parameters and cost to be fully depicted. 


Jigs) 


III. COST ESTIMATION RELATIONSHIP DEVELOPMENT 


A. DATA COLLECTION 
The foundation on which a house is built will determine 
whether or not it will stand the test of time. Such is the 
relationship between data and derived CERs. The problem is 
that the analyst must pick and choose useful data from a 
mountain size stack of collected records and forms. The 
quality of the CER, like the test of time upon a house, can be 
no better than the data that Ye 1s burl: pen 
1. Cost Data 
The focus of this study is the amphibious tracked 
vehicle. However, when developing CERs the size of the 
population becomes a paramount variable and in most 
occurrences the population must be narrowed to a specific 
application. This is not the case with the amphibious assault 
vehicle with its unique ability to land from sea to shore. 
Consequently, this narrowed group was broadened, taking into 
consideration the dual military requirement of both over-the- 
horizon and sustained maneuver combat ashore. The following 
reasons lead to this decision: 
a. The only available specific type amphibious assault 
vehicle historical cost data would have been from the 
AAV7. This weapon platform has been the standard for 
nearly two decades and represents the only dual role 


vehicle capable of both land and sea operations in U.S. 
inventory. 
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b. The use of a single platform for source cost data would 
have limited the development of the CER to the 
capabilities of that vehicle. The follow on to the AAV7 
will be tasked to perform two new missions’ types 
simultaneously that of OTH amphibious landings and sustain 
maneuver warfare with similar speeds to that of the MIAl1 
Abrams Tank. 

Vehicle types, such as the Bradley Fighting Vehicle 
and the M1A1 Abrams Tank, were aggregated together base upon 
expected performance parameters of the new Advance Amphibious 
Assault Vehicle (AAAV). Extreme care was necessary to select 
those parameters that would minimize distortion of an estimate 
due, to significant physical and/or performance differences. 

A final consideration to disaggregate costs into 
subsystems of platforms like engines, transmissions, and body 
type was made. This disaggregation allows the analyst to pin- 
point any subtle relationships that may exist between 
subsystems that would go unnoticed ina aggregate cost model. 
However, the focus of this study is to establish a 
relationship involving advance performance requirements and 
costs not of subsystem costs. 

2. Performance Data 

Performance data was collected from a single source, 
Jane's All the World's Armored Vehicles (various additions), 
in order to minimize possible distortion in developing an 
estimate that could occur when using multiple sources. The 


main advantage from using such a technique is that all 


performance data are likely have been collected in the same 


Li 


manner or at least in a consistent manner over time. Units of 
measurement must be standardized to include environmental 
factors that might affect performance outcomes. For »this 
study speed is measured in kilometers per hour (k/hr), weight 


in kilograms (kg), and range in kilometers (km). 


B. DATA ANALYSIS/ADJUSTMENT 

After all data is gathered, the analyst must ensure that 
it is consistent and comparable, and in most cases it is 
neither (Batchelder and others, 1963). 

1. Cost Data 

The cost data for this study was obtained from many 

government agencies and reports. The data was broken down 
into three types: Research Development Testing and Evaluation 
(RDT&E); Procurement (Proc.); and Operating and Support (O&S). 


Seven type weapon's platforms were selected as possible 


candidates. However when considering the wide range of 
required mission performance requirements, all seven 
candidates were considered viable. The major problem 


encountered with such a diverse group is that the cost data is 
not collected consistently throughout the Defense Department. 
Reasons for this phenomenon range from different type 
contractors to different methods when applying learning curve 
rates. Consequently, it was decided to Jimit ene 


diversification as much as possible and use a single source, 
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U.S. Weapon Systems Costs 19XX (various editions) to achieve 


consistent cost data. 

Utilizing this single source, all cost data were 
available except for O&S. Most importantly, the method of 
obtainment would be consistent and comparable over this 
diverse population of vehicles. The only adjustments needed 
for the RDT&E and Proc. cost dollars were to normalize the 
amounts to a consistent year. Utilizing 1985 as the base 
year, the statistical computer software program PACER 
generated the deflator table that was used throughout the 
analysis, that can be seen in Appendix A. 

The O&S cost data was mainly obtained through the 
Marine Corps Combat Development Command (MCCDC), provided in 
a report form from the Center for Naval Analyses, CNA. The 
data once obtained needed to be normalized to the standard 
twenty year operating life cycle and inflated to constant year 
dollars. 

2. Performance Data 

As previously discussed in section A.2. of this 
chapter, a need for consistent and comparable performance 
parameters iS paramount. This requirement lead to the 
selection of the sole source data base. Therefore the 
unwanted distortion that occurs with the assimilation of such 
information was eliminated. As mentioned in the previous 


section, seven candidate vehicles were chosen for the analysis 


Eo 


in large part due, to the mission requirements of the AAAV. 
Only one vehicle needed adjustment to make it comparable to 
Ene population. 

Using both performance and cost data adjustments, the 
data base table, Table 1, was created and will be used 


throughout the analysis in developing a life cycle cost CER. 


TABLE 1: DATA BASE TABLE 


Crew Range Speed Weight RDT&E £Proc 


km k/hr kg 
22483 


AAV7A1 PRE) Ssh 


M1A1 57154 


uCAC 172720 


M113A1 1a Boys 


LAV-25 10369 


M60A3 : OZ, Bo: 





Note: (1) Weight is combat weight. (2) All costs are in 
millions of dollars. (3) Procurement costs were derived as 
illustrated in Appendix F. (4) LCAC O&S obtained from CNA 
report CRMS0-2537Janmuam sero te 


The significance of Table 1 is that the CER development will 
come from a consolidated, consistent and valid source of 


information. The end result will be a CER that can accurately 
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depict the cost effects of changing performance parameters on 


EEGCwcosts.. 


C. DATA MANIPULATION 
All statistical manipulations were performed using the 
software package Parametric Cost Estimating Relationship 
Module (PACER) developed by DAI Inc. for use at the Defense 
Systems Management College (DSMC). Within the software 
MeckKage Utilizing the applications subprogram, Cost Estimating 
Relationships (CERs) can be developed from resources and 
physical or technical parameters of a particular weapon 
system. This subsystem enables the user to perform regression 
mm@elysis On input data in any of seven standard forms (linear, 
power, exponential, semi-log a/b, quadratic or log-linear). 
The user also, has the option of allowing the computer to 
select the best fit regression equation (Pacer Manual, 1990). 
In this study, all regression analyses were computer generated 
utilizing the best fit regression technique. 
if otacrstical Tools 
toeoweneritorming thes regression analysis, PACER 
provided many statistical outputs to allow the analyst to test 
the validity of the regression equation to the various inputs. 
mee tOllowing iS a brief description of the statistical 


outputs that were verified. 


Zak 


a. Accuracy of Equation 
To determine the accuracy with which the estimating 
equation describes the sample observations, the analyst must 
use the statistical measure of coefficient of determination 
(R*), coefficient of variation (CV), and standard error (SE) 
(Batchelder and others, 1969). 
(1) Coefficient of Determination 
Known as R‘, the coefficient of determination 
measures the association between two or more variables by 
relating the degree of variation in the dependent variable , 
cost , to the variations of the independent variables, 
performance . For this study an R' value of 80% is considered 
acceptable (Miller and Sovereign, 1973). 
(2) Coefficient of Variation 
Known as CV, measures the association between 
standard error to the mean of the sample dependent variable. 
For this study a value of less than 20% is considered 
acceptable (Batchelder and others, 1969). 
(3) Standard Euror 
Known by SE, is defined as the square root of 
the unexplained variance of the dependent variable. The 
smallest SE was the goal for this study because, the smaller 
the better the estimating equation (Batchelder and others, 


TIGo 
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b. Validmty of Equation 
To establish the validity of a multi-variable 
regression equation, the statistical measures of t-ratio and 
F-statistic provide the analyst a method to ensure that the 
derived equation will provide the most accurate results. 
Cy Sea ratio 
Used in multiple regression analysis to 
indicate the Significance or nonsignificance between 
explanatory variables that leads to determination of whether 
there exist an unacceptable strong relationship between those 
variables (Batchelder and others, 1969). For this study, a t- 
ratio greater than two was acceptable (Miller and Sovereign, 
moI73). 
(2) Sees taba Stic 
Used in regression analysis to determine 
whether an incremental improvement associated with the 
addition of a variable is significant (Batchelder and others, 
mo69). For this study, a F-statistic greater than four was 
considered acceptable. 
2. Statistical Data Table 
To summarize the statistical requirements used to 
determine whether a CER was acceptable or not is illustrated 


mae che following table: 
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TABLE 2: STATISTICAL PARAMETERS 


R? 


CV 


se 


t-ratio 


F-statistic 





The consolidation into Table 2, statistical qualifiers to test 
the validity of CERs is consistent with similar studies of 
parametric cost estimating. One example of such a study was 
conducted upon Marine Corps Medium Lift Helicopters where CERs 
were evaluated ina similar manner as in this study (Gaioni 
and Polley, 1990). Utilizing information from Table Iivaee 
Table 2 qualifiers, the trade-off on increasing range and 
speed in life cycle cost terms of the new AAAV will be 


apparent. 


D.. CER. DERIVA On 
1. RDT&E Cost Model 
Utilizing the data available from Table 1, the 
variables RDT&E costs, and the performance parameters of 
range, speed, and weight for the total population, multiple 


regressions were perform that are illustrated in Appendix 2 
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using statistical parameters as established by Table 2 


resulting in the following model: 


MODEL I 


RDT&E Costs = -3096.729 + 2.414 Range + 35.944 Speed 


As illustrated, the best fit equation determined by PACER was 
a linear regression equation. This equation was based upon 


four vehicle types as illustrated in the following table: 


TABLE 3: RDT&E DATA 
OS reas 
Vehicle RDT&E 


AAV7A1 


BFV 


M1A1 


LCAC 





The vehicles were chosen to fulfill the dual role requirement 
that the AAAV be capable of both OTH and sustained land 


warfare. 


ZS 


The statistical parameters of this model are as follows in 


Table 4: 


TABLE 4: RDT&E STATS 


TT ee a —_ — a - a ee 


Parameter Acceptable Achieved 


Ree) 
o> 


lee 


24.7(R)/22. 29 


F-statistic 367.4 





2. Procurement Cost Model 
Utilizing Table 1, analyzing all seven type vehicles, 
a multiple regression analysis was performed as illustrated in 
Appendix 3. With consideration to the constraints as listed 


in Table 2, the following cost model was developed: 


MODEL II 


Procurement Costs = -27.199 + .055 Range + .026 Speed 
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PACER selected the linear form of regression equation as best 
fit. This equation was based upon a final population of four 


vehicle types that are displayed in the following table: 


TABLE 5: Proc Data 





The population selection represents consideration for the 
mission duality for the new AAAV. 
The statistical measurements achieved from this 


regression are as follows in Table 6: 
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TABRE. Giigeroc: Stat 


Parameter Acceptable Achieved 


EsLatio 14.6(R)/9.1(S) 


F-statistic 813.4 





3. Operating and Support Cost Model 
Using O&S cost data and the performance parameters of 
range, speed, and weight on four vehicles as illustrated in 
Table 1, multiple regression analysis that can be seen in 
Appendix 4 was conducted utilizing requirements as set forth 


in Table 2 in the development of the following model: 


MODEL Jif 


O&S Costs = -2097.358 + 5.248 Range + 15.297 Speed 


This linear expression was selected as the best fit regression 
equation as determined by PACER for the given inputs. The 
equation was based upon a population of four vehicles as 


illustrated in the following table: 
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TABLE 7: O&S Data 


venue le Range S O&S , 
| | 


AAV7A1 


M113A1 


LAV-25 


LCAC 





The population selection included consideration that only one 
vehicle had reach its 20 year life cycle. 

The statistical results achieved from this regression 
analysis are displayed in the following table: 


TABLE 8: O&S Stat 


F-statistic 





4. Cost Model Summary 
As illustrated by Tables 3,4,5,6,7, and 8, the CER 


Cost Models I,II, and III are statistical sound. The purpose 


zo 


of this study is to develop a model for predicting life cyan 
cost as mandated by required performance parameters. The 
result was the development of three separate cost elements 
that when summed together provide just that. Furthermore, 
according to the statistical results achieved by the costs 


models, an accurate LCC estimate can be achieved. 
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IV. CONCLUSIONS AND RECOMMENDATIONS 


A. COMPARISON OF COST PREDICTIONS 
The three models formulated for life cycle cost prediction 


are summarized as follows: 


MODEL I 


RDT&E Costs = -3096.729 + 2.414 Range + 35.944 Speed 


MODEL II 


Procurement Costs = -27.199 + 755 Range + .026 Speed 


MODEL III 


O&S Costs = -2097.358 + 5.248 Range + 15.297 Speed 


The objective of this study was to relate performance 
parameters to three areas of cost to arrive at an accurate 
prediction of life cycle cost. Given these derived models, 
the analysts must determine whether or not the outcomes 
associated with the predictions make sense. For this study, 
predicted life cycle costs were obtained from the AAAV program 
office as illustrated in the report, Preliminary Life Cycle 
Mest Estimate (LCCE), 11 May 1988. The LCCE costs were 


prepared in response to Milestone 0 requirements as required 


ot 


by the acquisition process. This report was considered valid 
for this study and will be the basis for a comparative 
analysis of this study's cost predictions. 
1. RDIGES@ests 
From the LCCE, the RDT&E Costs were based upon 1375 


basic vehicles as illustrated below: 


RDT&E Costs (FY88) = $709,436,000 


Using Model I and the desired performance requirements that 
are required to meet mission objectives as stated in Chapter 
I and referred to in an article in the Marine Corps Gazette, 
September 1991 issue, titled "AAAV Program Nears Milestone", 


the following RDT&E Costs are derived: 


RDT&E Costs (FY88) = -3096.729 + 2.414(498) + 35 9440725 


RDT&E Costsy=a57 07 20000 


The difference between the derived RDT&E Costs and those 


provided in the preliminary LCCE are as follows: 


RDT&E Costs Difference = $1,646,000 
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This equates to less than 1% difference between predictions. 
Therefore, the derived RDT&E Cost Model seemingly predicts 
costs as accurate as the LCCE Cost Model. 
2. Procurement Costs 
Using the LCCE, the procurement costs were based upon 


1375 basic vehicles as displayed below: 


Procurement Costs (FY88&) = $3,603,139,000 


Using Model II and the desired performance parameters, the 


following procurement costs are derived: 


Procurement Costs = -27.199 + .055(498) + .026(72.4) 
Procurement Costs = $2.0734 per unit 
Total Procurement Costs =(1375 units)$2.0734 per unit 


ltortalvrroeurement Costs = $2,850,925e8000 


The difference between the derived procurement costs and the 


mecte costs is as follows: 
EeGcurenMenwmcoses Difrerence = S752,214,000 
This equates to a 20.9% difference between predictions. In 


the opinion of this author, this significant difference can be 


attributed to the methodology used by each study. The LCCE 


SS 


was based upon the more traditional method of obtaining 
theoretical first unit cost, unlike this study that used only 
historical data and require performance parameters. 
3. Operating and Support Costs 
The predicted O&S Costs for the required 1375 basic 


vehicles as presented in the LCCE are as follows: 


O&5 Costs (FY88) = $2,276) 6G22e@ 


Utilizing Model III and the required performance parameters, 


the following O&S Costs were derived: 


O&S Costs = -209/7.358 + 5.248(498) ei 5e2 3 eee 


O&S “Costs (PY90)} = soz oer 


To deflate the predicted cost to FY88 dollars, Appendix A was 


used and the results of that computation are as follows: 


O&5 Costs (FY85)=$1623.65/712517 4=Sueee 


O&S Costs (FY88)=$1383(1.098)=$1518.534 


O&5 Costs (FY88) = S1,o06, 5347008 


The difference between the cost predictions are as follows: 


O&S Costs Difference = S756m3207 200 
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This equates to a 33.3% difference between predictions. Like 
precurement — cost, this nmunicres difference can be 
attributed to the attainment of cost data. The methodology 
used by this study used only required performance parameters 
Beer historical cost datasfrom similar technologies. On the 
other hand, the LCCE broke cost down into a more traditional 
meenionh which im this author's opinion can account for the 
diverse differences. 
4. Life Cycle Costs 

After aggregating all three cost predictions together 

fem both the LCCE report and this study, the following life 


cycle cost are achieved: 


bee (GeCE) = $6,589,437 ,200 (FYS88) 


Bee misma, = So 707/, 2495000 .(FYSs) 


The major difference between the two predictions specifically 
metl into the application of methodology. This study was 
solely based upon the development of cost estimating 
relationships uSing parametric costing techniques. The 
Peetiminary LCCE used the traditional method in its cost 
development. ine "Most Significant “differences came from 
procurement costs and O&S costs. The procurement costs 
developed by the LCCE used input parameters such as weight, 


engine type, and transmission type in developing theoretical 
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first unit cost leading to a final total procurement cost Gas 
The operating and support costs developed in the LCCE report 
broke down the twenty year costs into specific areas such as 
personnel required, depot maintenance, and spares. This 
method is both cost intensive and labor intensive to develop. 
For any cost estimation, the analyst must be able to provide 
adequate documentation to enable the requester, in this case 
the program manager, to verify the validity of the projection. 
Even with two significantly different predictions as 
illustrated here, the program manager can decide which of the 
approaches best fit his needs at the time. Early in the 
development of a program a guick and reasonable estimate like 
the one provide by this study can aid in his decision process 


on issues of affordability. 


B,. PARAMETRIGSRIOK ANAT ols 

There are trends in the development of parametric cost 
estimating to link it with statistical risk analysis. The 
statistical approach used by the analyst can be used to 
quantify the uncertainty with developed cost estimations 
(Stewart and Wyskida, 1987). The statistical information that 
is used to derive a CER can be used to establish confidence 
bounds about the regression line. These confidence limits 
take into account both standard deviation associated with 
unexplained variances in the CER data base and the distance 


from the mean of the independent variable (Stewart and 
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Wyskida, 1987). This leads to conclusions about the derived 
CER uncertainty to whether or not the estimate would not 
exceed this value with a derived confidence level. The most 
commonly used test to determine whether an incremental 
improvement with the addition of a variable is the F-statistic 
(Batchelder, C. and others). Theoretically most experienced 
managers would like to try to achieve a confidence level of 
95% on cost estimations (Stewart and Wyskida, 1987). 

In this study, three separate CER cost models were 
developed. Associated with that development, confidence 
bounds were established that require further investigation. 

eek Olak CER 

Utilizing the software package, PACER, the following 


best fit regression equation was determined: 


RDT&E Costs = -3096.729 + 2.414 Range + 35.944 Speed 


The established confidence limits on the coefficients derived 
from this CER were 95% for range and 95% for speed. Based on 
mois intormation and the F-statistic being 95%, the results 
are well within the desired range of 95% as previously stated. 
2. Procurement CER 
Poatwiemutethizing = PACER, the following best fit 
regression equation was determined: 


Procurement Costs = -27.199 + .055 Range + .026 Speed 


if 


The associated confidence levels on the coefficients were 95% 
for range and 90% for speed. Based on this information and 
the F-statistic being 95%, it would seemingly lead to the 
conclusion that the results are well within the desired range 
of 95 % as previously stated. 
3. Operating and Support CER 
Utilizing the PACER statistical software package, the 


following best fit regression equation was arrived at: 


O&S Costs = -2097.358 + 5.248 Range + 15.297 Speed 


The associated confidence levels on the coefficients for both 
range and speed were like procurement cost CER 95% and 90%, 
respec pea iye As stated in the previous section, "une 
information in conjunction with the F-statistic being 95%, the 
results are well within the desired limitation of 95%. 
4. Summary 

Taken all the established confidence limits into 
account, the program manager might be tempted to accept these 
derived CERs as a fairly accurate predictor of “cost, Bie 
more explicit definition of uncertainty must be addressed. 
The levels of confidence are linked to the data plot of CERs 
as reflected by the standard error. In other words, the 
confidence limits reflect only those risk factors that caused 


the dispersion in the original data. Therefore, if thesaaee 
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changes before the confidence levels are established then the 
confidence statement might be i aa, This is due to 
the fact that the data is based upon historical data which are 
basically stagnant unlike continuously changing data of a 
process line. The program manager in concert with the cost 
analyst must weigh this fact when considering the validity of 
CER cost predictors (Stewart and Wyskida, 1987). 

Other cost risk analysis techniques involving Monte 
Carlo simulation, network analysis and a host of other risk 
assessment techniques, allow the analyst to deal with 
uncertainties like those associated with input data and their 


Beeects upon cost are beyond the scope of this study. 


m  OLHER STATISTICAL CONSIDERATIONS 
1. Residual Analysis 

The validity of any derived regression equation can be 
verified by analyzing residuals. Residuals are developed when 
taken the data used to develop a CER and reapplying it through 
the derived CER resulting in estimates, in this case costs, 
that can be compared to the original value. foe etwaeeh the 
deviations from this technique will illuminate any apparent 
problem with stratification of data (Batchelder and others, 
mo69). In laymen terms, the stratification of a data means 
the grouping of data points that can indicate the existence of 


a subtle relationship associated with the independent 


oS) 


variables. These relationships may need further investigating 
because they can misconstrue the regression analysis. 
a. RDT&E Costs 
The software package, PACER, derived Model I to 
describe the behavior of the provided RDT&E cost data as 


follows: 


RDT&E Costs = -3096.729 + 2.414 Range + 35.944 Speed 


After applying the original data used in the development of 
this CER the following table, TABMER n= -ul ean 


TABLE 9 : RDT&E RESIDUALS 


Vehicle Act Cost Est Cost Deviation 


(3M) ($M) (Act-Est) 


AAV7A1 


laa 





The data plot of actual cost versus estimated cost can be seen 


in Appendix E. After analyzing the derived data and the data 
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plot, the derived CER was considered valid since no major 
stratification seem to exist. 
b. Procurement Costs 

The best fit regression equation as derived by 

PACER statistical software to describe the behavior of 


procurement costs are illustrated by Model ITI: 


Procurement Costs = -27.199 + .055 Range + .026 Speed 


iemiazing the original data with application back through this 
derived CER Model, the following table resulted: 
TABLE 10 : PROCUREMENT RESIDUALS 


Vehicle Act Cost aM te tee Deviation 


($M) (SM) (Act-Est) 


BFV 


AAV7A1 


MiAl 


M6043 





The data plot of actual cost versus estimated cost can be seen 


in Appendix E. After careful consideration for both the data 


41 


plot and Table 10 results, the derived CER was considered 
valid with no stratification of data being noted. 
c. Operating and Support Costs 
Utilizing the software package PACER, Model III was 


developed to describe the behavior of O&S cost data: 


O&S Costs = -2097.358 + 5.248 Range + 15°97 "Spee 


Utilizing the original data with re-application to the derived 
CER model, the following table resulted in the descriptions 


O&S residuals: 


TABLE 11 : O&S7RESTOUsES 


Vehicle AGrmeost Est Cost Deviation 


($M) 


AAV7A1 


Pleo 1 


LAV-25 


LCAC 





The data scatter plot of actual versus estimated cost can be 


seen in Appendix E. Utilizing the data plot analysis and the 
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results from Table 11, the derived O&S Cost CER was considered 
valid due to the absence of any pi = bake Strate cat won of 
data. 
d. Residual Analysis Conclusion 
Considering the available data plots in Appendix E 
and Tables 9, 10, and 11, the derived cost estimating 
relationship were all considered valid when considering the 
stratification of data as means to test the statistical 
significance. However, another statistical parameter that is 
readily available to help demonstrate the validity of 
explanatory variables used in the deviation of CERs is the 
@errelation coefficient. 
fee Correlation Coefficient Analysis 
There exists numerous statistical tools that can aid 
in the evaluation of parametric cost models such as 
@eetficient of determination (R’) and standard error (SE), and 
the correlation coefficients all of which need to be evaluated 
MeeMoltler .and Sovereign, 1973). A model must contain 
Borrelation coefficients that are statistically significantly 
Merterent from zero. Any variables that are not should be 
dropped from consideration in the evaluation. ie eh Ss 
analysis, the final derived Cost Model CERs I, II, and III 


generated the following correlation coefficient matrices: 
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TABLE 12 2: RDT&E CORRELATION COEFFICIENT Arn 





TABLE 13 : PROCUREMENT CORRELATION COEFFICIENT MATRIX 


Procurement 


Procurement 


Range 


Speed 





TABLE 14 : O&S CORRELATION COEFFICIENT MATRIX 
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From this information, the conclusion reached by this analysis 
is that all final CER Cost Models seemingly have the necessary 


correlation coefficients in all explanatory variable cases. 


D. FINAL CONSIDERATIONS 
This study's aim was to develop a method to predict life 
cycle cost using only performance parameters and similar 
historical cost data. The statistical requirements were met 
consistently to all available standard comparisons. 
Therefore, the study reinforced the fact that parametric cost 
estimating techniques provide a viable alternative to more 
expensive cost estimate developments. When considering 
today's world of the never-ending shrinking Defense Budget, 
eme utilization of this techniqué will only grow. The biggest 
drawback for the program manager when using this technique is 
that it is limited to the accuracy of the data base. 1f the 
data base can be verified cheaply and the information is 
readily available then the use of parametric cost analysis 
will know unlimited bounds. 
1. Future Research 
The use of performance parameters to develop a cost 
estimating relationship is data dependent. Only long term 
data refinement will aid in generating accurate cost data. 
The future of this field is just starting to open and the 
application of these techniques will only add to the 


development of performance base cost estimating. 
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The use of PACER statistical software developed for 
DSMC for their acquisition management training ~1S ine 
infancy stage. Further refinement in its use will help 
standardize the cost development procedures throughout the 
Defense Department. 

As the AAAV proceeds through its development down that 
milestone acquisition line, the validity of this derived CER 
for life cycle cost can be tested. The more developed the 
system becomes the more refined the cost model should become 


and the more useful to new cost analysts of the future. 
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APPENDIX B-RDT&E CER DERIVATION 


A. 1ST ITERATION 

NUMBER OF OBSERVATIONS:7 (BFV,AAV7A1,M1A1,LCAC,M113A1 ,LAV,M60) 
NUMBER OF VARIABLES:4 (RANGE,SPEED,WEIGHT,COSTS) 

RDT&E COSTS= 5.142e7*" RANGE’’'* SPEED!**? WEIGHT? "'!ng. 49 

ican 2a SE=256.53 F-statistic=1.678 
@-ratio=ZeZn/1 73572. oW 

RDT&E COSTS= -66.631+.012WEIGHT-6.8e ''WEIGHT'pg.51 

a 32S SSP oes F-statistic=.974 t=-ratio=ie 
RDT&E COSTS=9.9e° RANGE’ 'SPEED' ‘pg. 50 

ee SE=374.2 F-statistic=.5 t-ratio=.8R/.65 
RDT&E COSTS=-2256.5+66.9SPEED-.43SPEED'pg.54 

Ree 2S SE=296 F-statistic=.66 t=-ratio=l 
RDT&E COSTS=.002RANGE'''’pg.53 

Ree Sa 8a S F-statistic=.79 t-ratio=.89 
RDT&E COSTS=-66.631+.012WEIGHT-6.8e 'WEIGHT'pg.56 

i oO SE=20 on F-statistic=.974 t-ratio— ie 
RANGE=1514.8-30.9SPEED+.215SPEED‘*pg.55 

eee Sr= 1! 30m, F-statistic=.9 t-ratio=-1@ 
WEIGHT=207346.875-429.6RANGE+584.5SPEED pg.52 


R?.897 SE=2.24 F-statistic=17.5 t-ratio=-5.9 


48 


at ee 


wm 


GRAPHS 


B.. 


ES 


etl 


660.6 


pin 
arm 
Gi 
C 


26. & 


REGRESS IGN EQUATION PLOT 


a a le a eee ee i ee ne 








ee Re pt 











— 


LINEAR SCALE 





ee ee es ee ee ce et 


+ 


a a a tC re ei ee ee ee ee ee 


90.6 peat S i 


eS 


m—MOO Psa 


REGRESS TION EFQUATION PLOT - LINEAR SCALE 


‘ 
8 0 0 a @ nn nn enn ee ee AE SS te hr Beet Sa A OS Ee eee ee a eee mee, 


666.6 
1066.6 


260.G 


| 
| 
| 
! 





Sr rie ees age eee gang Ee ee OE ee ~_—-' - 


G.a 208.6 4486.0 606.0 SOMA 
RANGE 


prj 


me Oo 


86G. 


460. 


2uG. 





REGRESSION EQUATION PLOT -— LINEAR SCALE 


ey eS 


45646 .0 





———————— 


94600 .U 
WEI GI 


a 


2 a a ees | Se vier 


| 135606.6 
iti 


ro 


ee es ee ee eee em -_— 


t 





ee ren ee eee = - 


iFM, 


—— 
LE LY Se AA ES AY s+ 6+ + a Me 


cid 


Le a 


ee 


OO; 


DATA PLOT —- LINEAR SCALE 





Rem aS a —_— we eh] 
Y 
668.6 
i 1 
+ j 
408.6 
266.U 
t 
< ‘ 
aioe rt—“‘“‘“‘“‘ SS ee 


—_—— a ay aie ee ee ES LS EE LY LE A ES ET Sn a 


Ww. 26U.0 460.6 6G6G.6 
RANGE 


isis. is 


4 
« 
* 
me ee ee ee + 8 eee ee ee 


—— a a 


O) 
uo 


Fa 


mi OO; 


wu 
Pant Ne ec a ee 


1 6G 


DATA PLOT - LOG LOG SCALE 


a re ee cate eee an ee EE af Sg re ee SS eee 


RANGE 


Oe ee ee re ge es A ee ee ee ee ee ee ee ee. 


Ae ee ee ae 


me ree ee tee ae ee 


L aeeis 


§ 
' 
1 
¢ 
‘ 
2 a ee ee ee ee ee ee ee ee ee ee ee 


a et tS ee Et te = 





Gb. 
wa. 


te me eee 


+ t 


-_—_—_s tooo Oooo se oe oo eo oro 


30.6 


64.4 
Ee OW 


+ 


TS fe ee 


4 


Dee. G 


ww ee eee 


me ee ee a elt ee et 


i tid .96 





OE tee ee ee me 


16GG 


i ts 


1u 


lta 


Dhif PLOT 


Oe ee TE TT AS ee le A ES tS A eS TE ED AES ey et ce neti A rime. a nt = a te a re ee et er ee ae ee ee 


SS SE OS eS TS SS SAAD ASG C6 uP e yen aie as wD sedis Gwe Su w+ 


- LOG LOG S$CaLe 





ee ee ee ee 


SN TTS SS SS ES TS = NN Te ORD “An uN eT eS mee 


1G 
» PEED 


a ee -- = we 


er ee ee ee 


SS SE |S eS A A LE OS AE i aS A I | il ES AS ST OF LT SPP fj Se Ss SPONGES Sui AY sm b+ s mers seer 


ao 


— a 
ra | es Sh Se 


me 


G6OH.@0@. 


660.6 


400. G 


helt. G 


i. 4 a 


Ww. 


} 


+ 


45006 .G 


DATA PLOT - LINEAR SCALE 


ee te Ee A a NE 


| ” 


9OHGUG.G 
WEEGHE 





L35uou.a 


LEIS DE EL NS A ol ey fees ee 


4 


Ne A A Sy eee ee re ae ee ee rr ee te ee ee 


Ltd acai 


— oe. 


$.i4 


Teeter oe Ee ee ewe ey 


Ce me 9 a ae a 


a ee 9 ate ree me nm  o= 


C. 2ND ITERATION 
NUMBER OF OBSERVATIONS:4 (AAV7A1,M113A1,LAV,M60) 
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A. 1ST ITERATION 

NUMBER OF OBSERVATIONS:7 (BFV,AAV7A1 ,M1A1,LCAC,M113,LAV,M60) 
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C. 2ND ITERATION 
NUMBER OF OBSERVATIONS:6 (BFV,AAV7A1,M1A1,M113,LAV,M60) 
NUMBER OF VARIABLES:4 (RANGE, SPEED,WEIGHT,COSTS) 
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E. 3RD ITERATION 

NUMBER OF OBSERVATIONS:5 (BFV,AAV7A1,M1A1,M113,M60) 

NUMBER OF VARIABLES:4 (RANGE, SPEED, WEIGHT, COSTS) 

PROC COSTS= -37.9+.08RANGE+.00001WEIGHT 
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A. 1ST ITERATION 
NUMBER OF OBSERVATIONS:3 (AAV7A1,M113,LAV) 

NUMBER OF VARIABLES:4 (RANGE,SPEED, WEIGHT, COST) 
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C. 2ND ITERATION 

NUMBER OF OBSERVATIONS:4 (AAV7A1,M113,LAV,LCAC) 
NUMBER OF VARIABLES:5 (RANGE,SPEED,WEIGHT,CREW,COST) 
O&S COSTS=468.7-5.15RANGE+.O14RANGE’ pg.102 
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APPENDIX F-PROCUREMENT COST DERIVATION 


Unlike the traditional method of obtaining procurement 


cost by deriving theoretical first unit cost, the following 


method was employed: 


Weapon System Cost/Quantity = Unit Cost 


Utilizing this equation the following table was derived: 


TABLE 15: PROCUREMENT UNIT COSTS 
| Vehicle Weapon § Quantity Unit Cost f 


| 
8270.5 


AAV7A1 Jn, 


M1A1 1845723 


LCAC OZ S36 


M113A1 4 mS 


LAV-25 Das 


M60A3 2488.4 





Note: (1) All Dollar amounts are in Millions. (2) Sourcesien 
data was U. S$. Weapon Systems Costs, 1991 by DSA. 


HiewreasOning in uSing average unit cost vice first unit cost 
was that the sample population represented such a diverse 
feeup with different rate of production and significantly 
different quantities produced. In this author's opinion the 
dual role requirement of the AAAV to conduct over the horizon 
amphibious operations and sustained maneuver land warfare 
justified this action. Since today no one technology or 
weapon's platform realistically can achieve this requirement 
to use historical procurement cost data based upon theoretical 


first unit cost would be misconstruing to the analysis. 
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